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Multi-Version Hosting Of Application Services 

BACKGROUND OF THE INVENTION 

5 1. Field of the Invention 

The present invention relates to the field of hosting application services. 
More specifically, the present invention relates to the issue of concurrently hosting 
application services with multiple versions of the hosting services. 

10 2. Background Information 

With advances in integrated circuit, microprocessor, networking and 
communication technologies, increasing number of devices, in particular, digital 
computing devices, are being networked together. Devices are often first coupled to 
a local area network, such as an Ethernet based office/home network. In turn the 

15 local area networks are interconnected together through wide area networks, such 
as ATM networks, Frame Relays, and the like. Of particular notoriety is the TCP/IP 
based global inter-networks, the Internet. 

As a result this trend of increased connectivity, increasing number of 
applications that are network dependent are being deployed. Examples of these 

20 network dependent applications include but are not limited to, erjiail, net-based 
telephony, world wide web and various types of e-commerce. Further, increasing 
number of software applications that were traditionally licensed or distributed 
through discrete distribution medium, such as diskettes, CDROMs and the like, are 
being distributed online or offered as web based applications, through private 

25 intranets or public networks like the Internet. 
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The increased popularity of network based applications and offering of 
traditional software applications as application services have in turn led to the 
emergence of application service providers who host application services for their 
developers, to relieve the developers from having to maintain and operate the 
5 underlying infrastructure. To differentiate from one another, application service 
providers may offer hosting services or hosting runtime supports that offer 
functionality, usability or performance improvements over their competitors. 

Thus, just like any traditional system and subsystem software developers, 
application service providers have a need to continually upgrade and enhance their 
10 hosting runtime services. Likewise, just like any traditional system and subsystem 
€s software, the upgrades and enhancements could have significant impact on the 

q application services they host or support. In fact, the impact of upgrades or 

3 : I 

il enhancements to the hosting service runtime support potentially could be more 

m profound than traditional system or subsystem software. In the case of traditional 

JU 15 system/subsystem software, generally not all licensees upgrade their system at the 
i;^ same time. As a result, they tend to impact the earlier adopters only. However, in 

|:f the case of application service providers, once the upgrades or enhancements are 

promoted, all hosted application services (and their millions of users) are 

immediately impacted. Thus, it is desirable for application service providers to 
20 provide concurrent support for multiple versions of its hosting services or runtime 

support to allow gradual adoption of the new versions by the hosted application 

services. 

However, offering concurrent support of multiple versions is not simply a 
matter of making the various versions available. Preferably, the concurrent support 
25 is provided in a transparent manner to the hosted applications, automatically 

employing the appropriate version of hosting services/runtime support. Further, as 
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time goes on, the multiplicity of versions would inevitably become a significant 
burden to the application service providers, and resources become inefficiently 
utilized. For example, only a handful of infrequently used application services may 
still require the earlier versions of the runtime services. Thus, to treat all versions 
5 equally, in terms of initialization, resource allocations and like, would be extremely 
costly and inefficient. 

Accordingly, a new approach to hosting application services, and operating 
the resources of an application service provision apparatus to facilitate multi-version 
hosting of application services is needed. 

10 

Q 

Oj 

CJ SUMMARY OF THE INVENTION 

nj An application service provision apparatus is provided with one or more 

p 15 components to perform a dispatching and a shared resource monitoring function to 

^ allow applications be hosted with multiple versions of a hosting service runtime 

. 

library in a more efficient manner. The dispatching function, upon receipt of a 
^ request for service for an application, determines if the version of the runtime library 

required is known. If not, the dispatching function turns to the latest version of the 

20 runtime library to determine the version required. In one embodiment, the required 
earlier versions are loaded only on an as needed basis. The shared resource 
monitoring function, upon detecting aggregated allocation of a shared resource 
reaching a pre-determined threshold, requests consumers of the shared resource to 
provide tracked last used times of their allocations. In response, the monitoring 

25 function selects a number of the allocations for release, and instructs the shared 
resource consumers accordingly. 
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In one embodiment, the dispatching and shared resource monitoring 
functions are implemented as separate components. In alternate embodiments, 
they are implemented as one component. 



BRIEF DESCRIPTION OF DRAWINGS 

The present invention will be described by way of exemplary embodiments, 
but not limitations, illustrated in the accompanying drawings in which like references 
denote similar elements, and in which: 

Figure 1 illustrates an overview of the present invention, including an 
application service provision apparatus having one or more components to perform 
a dispatching and a shared resource monitoring function, in accordance with one 
embodiment; 

Figure 2 illustrates the operational flow of the relevant aspects of the 
dispatching function of Fig 1, in accordance with one embodiment; 

Figure 3 illustrates a data structure suitable for use by the dispatching 
function of Fig. 1 to track the required version of the runtime library, in accordance 
with one embodiment; 

Figure 4 illustrates a data structure suitable for use by the shared resource 
monitoring function of Fig- 1 to track the last used time of shared resource 
allocations, in accordance with one embodiment; 

Figure 5 illustrates the operational flow of the relevant aspects of the shared 
resource monitoring function of Fig 1, in accordance with one embodiment; and 
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Figure 6 illustrates an internal component view of a computer system 
suitable for use to practice the present invention, in accordance with one 
embodiment. 



5 

DETAILED DESCRIPTION OF THE INVENTION 



In the following description, various aspects of the present invention will be 
described. However, it will be apparent to those skilled in the art that the present 
10 invention may be practiced with only some or all aspects of the present invention, 
yi] For purposes of explanation, specific numbers, materials and configurations are set 

m 

□ forth in order to provide a thorough understanding of the present invention. However, 

s a 

Lli 

{,£ it will also be apparent to one skilled in the art that the present invention may be 

C3 practiced without the specific details. In other instances, well known features are 

q 15 omitted or simplified in order not to obscure the present invention. 
%i Parts of the description will be presented in terms of operations performed by a 

fi processor based device, using terms such as data, tables, accepting, determining, 

3 "1 

■SIS' 

inquiring, notifying, caching, routing, loading, and the like, consistent with the manner 
commonly employed by those skilled in the art to convey the substance of their work 

20 to others skilled in the art. As well understood by those skilled in the art, the 

quantities take the form of electrical, magnetic, or optical signals capable of being 
stored, transferred, combined, and otherwise manipulated through mechanical and 
electrical components of the processor based device; and the term processor include 
microprocessors, micro-controllers, digital signal processors, and the like, that are 

25 standalone, adjunct or embedded. 
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Various operations will be described as multiple discrete steps in turn, in a 
manner that is most helpful in understanding the present invention, however, the 
order of description should not be construed as to imply that these operations are 
necessarily order dependent. In particular, these operations need not be performed 
5 in the order of presentation. Further, the description repeatedly uses the phrase "in 
one embodiment", which ordinarily does not refer to the same embodiment, although 
it may. 

Overview 

10 Referring now to Figure 1, wherein a block diagram illustrating an overview of 

P 

€1 the present invention, including an application service provision apparatus equipped 

Q with a dispatching and a shared resource monitoring function, in accordance with one 

H embodiment, is shown. As illustrated, application service provision apparatus 108 

hosts a number of application services, e.g. 116i and 116n, on behalf of their 

a 

n 15 developers. Apparatus 108, enabled by features of the present invention, is 
p. advantageously equipped with different versions of runtime support, also referred to 

fi as the runtime library, e.g. 114i and 114n. The different hosted application services, 

¥ * for stability and/or other reasons, "require" these different versions of the runtime 

library. For example, application services 116n (perhaps because of certain new 
20 features offered) require the latest version 1 14n of the runtime library, while 
application services 116i (perhaps because of backward compatibility reasons) 
"require" an earlier version 114i of the runtime library. Clients 102a and 102b access 
these various application services, e.g. 116i and 116n (hereinafter, simply 116*), 
through networking fabric 106, using various known messaging protocols (e.g. HTTP) 
25 signaled in accordance with various known communication protocols (e.g. TCP/IP). 



Pugh et al - Multiple Version 
Hosting of of Application Services 



Express Mail# EL743034544US 
ATA/mjt 



Attorney Docket Ref: 410177001 



In addition to the hosted application services 116* and the various versions of 
the runtime library, e.g. 114i and 114n (hereinafter, also simply 114*), apparatus 108 
also includes one or more resources shared by the application services 116* and/or 
the functions of the runtime library 114*, e.g. memory resource 120. Further, in 
5 accordance with the present invention, apparatus 108 is provided with dispatcher 
function 110, and shared resource monitor function 118 to facilitate the current 
support of the multiple versions of runtime library, and efficient operation of the 
resources. Moreover, for the embodiment, dispatcher function 110 also has an 
associated application and runtime (RT) library version mapping cache 112. 
10 More specifically, dispatcher function 110 is employed to perform the 

O 

M J dispatching function, i.e. routing of requests for service from clients 102a-102b to 

uJ 

O selected ones of the application services hosted. As will be described in more details 

hh below, in one embodiment, dispatcher function 110 advantageously performs the 

k~ 5 

m dispatching or routing in a manner that allows the earlier versions of runtime library 

P 15 114* to be loaded on an as needed basis, thereby enabling apparatus 108 to support 
^ the multiple version as well as operate more efficiently. Monitor function 118 is 

^ employed to perform a monitoring function to allow resources such as memory 

¥ * resource 120 to be shared among application services 116* hosted and/or the 

functions of runtime library 114* (collectively also referred to as resource consumers 
20 at times, when convenient to do so). Accordingly, these elements together enable 
apparatus 108 to operate more efficiently, and in turn the practically to provider the 
multi-version support. 

Except for the provision of dispatcher function 110, its associated mapping 
cache 112, and monitor function 118 to facilitate efficient operation of apparatus 108, 
25 apparatus 108 including its runtime library 114*, application services 116*, client 
102a/102b and networking fabric 106 are all intended to represent a broad range of 
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such elements known in the art. In particular, examples of these application services 
include but are not limited to email applications, e-commerce applications, word 
processing applications, spreadsheet applications, and so forth, and clients 102a- 
102b may be wireless or wireline based computing devices of various form factors, 
5 including but are not limited to palm sized, notebook sized or desktop sized. 
Moreover, the present invention contemplates that apparatus 108 may be 
implemented using one or more computer servers interconnected in any one of a 
number of known coupling techniques, including but are not limited to dedicated 
channels, local area networks or wide area networks. Examples of runtime library 
10 functions include but are not limited to security functions, script functions, database 
access functions, and so forth. Accordingly, these elements, i.e. elements 108, 114*, 
P 116*, 120, 102a/102b and 106, will not be further described. Dispatcher function 

M- 110, including its associated mapping cache 112, and monitor function 118 will be 

U t 

J 

S3 described in turn below. 

2 

a 15 However, before describing these elements in further detail, it should be noted 

hi 

that while for ease of understanding, only a handful of application services 116*, a 



handful of runtime library versions 114* and a handful of clients 102a/102b are shown 
in Fig. 1, from the description to follow, it will be readily apparent to those skilled in 
the art that the present invention may be practiced with many more (as well as less) 
20 application services 116*, runtime library versions 114*, and clients 102a/102b. 

Further, while for ease of understanding, dispatcher function 110 and monitor function 
118 are described as separate functions, they may be implemented as one or more 
components. 



25 
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Dispatcher function 
Referring now to Figure 2, wherein a flow diagram illustrating the relevant 
aspects of the operation flow of dispatcher function 110, in accordance with one 
embodiment, is shown. The embodiment contemplates that at start up (i.e. power 
5 on/reset), for perhaps efficiency reason, only the latest version of the application 
service hosting runtime library 114n is loaded. Moreover, the latest version includes 
a dynamically callable function that upon invocation, returns the required version of 
runtime library 114* for a particular application service hosted. As illustrated, the 
operation process starts with dispatcher function 110 receiving a request for service 

10 targeted for a hosted application service from a client, block 202. Upon receiving 
such a request, dispatcher function 110 determines if the version of the runtime 
library required by the targeted application service is known to itself, block 204. If the 
version of the runtime library required by the targeted application service is not known 
to dispatcher 110, it invokes the earlier described dynamically callable function of the 

15 latest version of the runtime library to obtain the version of the runtime library required 
by the targeted application service, block 206. Upon obtaining the information, for the 
embodiment, dispatcher function 110 also caches the information in the earlier 
described mapping cache, thus making the information available for subsequent 
requests targeting the same application service (until the cache line holding the 

20 information is selected for use to cache the required version information of another 
application service hosted). [See Fig. 3 for an example of a data structure suitable 
for use as a cache for caching the required version information for the various 
application services hosted. An example of a suitable cache line replacement 
scheme is a least recently used (LRU) scheme.] 

25 Additionally, upon learning of the required version, dispatcher function 110 

determines if the required version has been loaded, block 208. If the required version 
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of the runtime library has not been loaded (e.g. the required version is an earlier 
version, and it has not been required by any of the targeted application services of 
prior requests), dispatcher function 110 loads the required earlier version of the 
runtime library on demand, block 210. In alternate embodiments, the present 
5 invention may be practiced with some or all of the executable code/libraries of the 
one or more of the earlier versions also pre-loaded. 

Upon determining that the required version is known to itself (i.e. the required 
version information is cached in mapping cache, implying that it has previously been 
requested, accordingly loaded) (block 204), or determining that the required version is 

10 not known but loaded (e.g. due to cache line replacement) (block 208) or for some 
embodiments, loading the required version (e.g. being required for the first time) 
(block 210), dispatcher function 110 routes the request for service to the targeted 
application service (which will be properly supported, as the required version of the 
runtime library is now loaded). 

15 Thus, it can be seen from the above description, the required version of a 

runtime library may be determined. Further, for various embodiments, earlier 
versions of runtime library 114* are loaded only on an as needed basis, i.e. when 
required by an application service targeted by a request for service received from a 
client. Accordingly, apparatus 108 may operate more efficiently, while allowing for 

20 multi-version hosting runtime support. 

Monitor function 

Referring now to Figure 5, wherein a flow diagram illustrating the relevant 
aspects of the operation flow of monitor function 118, in accordance with one 
25 embodiment, is shown. As described earlier, monitor function 118 is employed to 
facilitate the sharing of certain resources, e.g. memory resource 120, among the 
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resource consumers, i.e. the application services hosted and/or the functions of the 
various versions of the runtime library. The embodiment contemplates that various 
portions of shared memory resource 120 are allocated to the resource consumers on 
an as needed basis. Moreover, the allocation and the de-allocation requests are 
5 routed through monitor function 118. Further, the various resource consumers keep 
track of the usage of the various portions of shared memory resource 120 allocated. 
In particular, they keep track of the addresses and sizes of the allocations, as well as 
the time of last usage of each of the allocated portions of shared memory resource 
120. An example data structure suitable for use to track such information is shown in 
10 Fig. 4. 

As illustrated, upon initialization, monitor function 118 monitors the requests 
£3 and/or allocations of the shared resource, block 502. It further continually determines 

if the aggregated allocation, i.e. the total current cumulative allocation, has reached a 
pre-determined threshold, also referred to as the "high watermark", block 504. As 
U 15 described earlier, all allocation requests are routed through monitor function 118, 
*%t which maintains a counter to keep track of the current level of aggregated allocation. 

;': ! If the high watermark has not been reached, monitor function 118 simply continues 

^ operation back at block 502, and repeats the operation of block 504, until eventually it 

is determined that the aggregated allocation of shared memory resource 120 has 
20 reached the predetermined high watermark. 

At such time, monitor function 118 requests the resource consumers (more 
specifically, those who received allocations) to provide it with the usage records of the 
allocated resources, block 506. Of particular interest to be provided, is the time of 
last use of these allocations by the corresponding recipient entities. 
25 Upon receipt of these information from the resource consumers, monitor 

function 118 determines the allocated shared memory resources to be released to 
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bring the aggregated allocation back to at most another predetermined threshold, 
referred to as the low watermark, block 510. Upon making the determination, monitor 
function 118 instructs the resource consumers to release the selected resource 
portions accordingly. 

5 In one embodiment, monitor function 118 makes the determination by merging 

and ordering the usage information received from the resource consumers. From the 
merged ordered set of the usage information, monitor function 118 "speculatively" 
selects a number of the least recently used allocations for release to attempt to bring 
the aggregated allocation back down to the low watermark. 
10 Upon instructing the resource consumers, monitor function 118 continues its 

Q 

w operation at block 512, determining if the instructions were sufficient to bring the total 

ini 

□ consumption of the shared resource down to the low watermark. As the instructed 

£ t jj 

M resource consumers begin to free previously allocated portions of the shared 

C3 resource as instructed, monitor function 118 decrements the running counter it 

5 

□ 15 maintains for the amount of shared resources having been allocated. If the instructed 
n de-allocations were able to bring the aggregated allocation back down to the low 

fi s watermark monitor function 118 repeats the operation of block 510. In alternate 

r ' h embodiments, the entire sequence of operations of blocks 506-510 may be repeated 

instead. If the action or successive actions were successful in bringing the 
20 aggregated allocation back down to the low watermark, monitor function 118 

continues its operation at block 502. Thus, memory resource 120 may be efficiently 
shared among the resource consumers, i.e. the hosted application services and the 
functions of the various versions of the runtime library. 

As those skilled in the art would appreciate, other resources, such as data 
25 channels, may also be shared in like manner, under the control of monitor function 
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118 or a similar coordinator function, thereby allowing apparatus 108 to operate more 
efficiently. 



Example Computer System 
5 Figure 6 illustrates an example computer system suitable for use as a server 

for implementing application service provision apparatus 108 (or a portion thereof), 
in accordance with one embodiment. As shown, computer system 600 includes one 
or more processors 602 and system memory 604. Additionally, computer system 
600 includes mass storage devices 606 (such as diskette, hard drive, CDROM and 
10 so forth), input/output devices 608 (such as keyboard, cursor control and so forth) 

O 

y3 and communication interfaces 610 (such as network interface cards, modems and 

03 

o so forth). The elements are coupled to each other via system bus 612, which 

hi 

U represents one or more buses. In the case of multiple buses, they are bridged by 

C;3 one or more bus bridges (not shown). Each of these elements performs its 

? 3 15 conventional functions known in the art. In particular, system memory 604 and 
y mass storage 606 are employed to store a working copy and a permanent copy of 

^ the programming instructions implementing the dispatcher and monitor functions of 

^~ the present invention. The permanent copy of the programming instructions may be 

loaded into mass storage 606 in the factory, or in the field, as described earlier, 
20 through a distribution medium (not shown) or through communication interface 610 

(from a distribution server (not shown). The constitution of these elements 602-612 

are known, and accordingly will not be further described. 



Conclusion and Epilog 

25 Thus, an improved method and apparatus for hosting application services with 

multiple versions of the hosting runtime services has been described. While the 
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present invention has been described in terms of the above illustrated embodiments, 
those skilled in the art will recognize that the invention is not limited to the 
embodiments described. The present invention can be practiced with modification 
and alteration within the spirit and scope of the appended claims. For example, the 
resolution of the appropriate version of the hosting services may be performed by a 
version other than the "latest" version (e.g. when the "latest" version is a "beta" 
version), as well as by other means independent of the individual versions 
themselves. Thus, the description is to be regarded as illustrative instead of 
restrictive on the present invention. 
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